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Abstract. We obtain Berry-Esseen type estimates for ” nonconventional” ex¬ 
pressions of the form {'"-))) - F) where 

X (n) is a sufficiently fast mixing vector process with some moment conditions 
and stationarity properties, is a continuous function with polynomial growth 
and certain regularity properties, F = f Fd(/j, x ... x {i), {i is the distribution of 
X(0) and qi{n) = in for 1 < i < k while for i > k they are positive functions 
taking integer values on integers with some growth conditions which are satis¬ 
fies, for instance, when they are polynomials of increasing degrees. Our setup 
is similar to m where a nonconventional functional central limit theorem was 
obtained and the present paper provides estimates for the convergence speed. 
As a part of the study we provide answers for the crucial question on posi¬ 
tivity of the limiting variance lim 7 y/^_^ooVar(^ 7 y/^) which was not studied in M- 
Extensions to the continuous time case will be discussed as well. As in M 
our results are applicable to stationary processes generated by some classes of 
sufficiently well mixing Markov chains and dynamical systems. 


1. Introduction 

The classical Berry-Esseen theorem provides a uniform estimate of the error 
term in the central limit theorem for a sum of mean zero independent identically 
distributed (i.i.d.) random variables {X{n)}^^i. Namely, let be the distribution 
function of where cr = E{X{1))^ > 0 and $ be the standard 

normal distribution function then 

(1.1) sup |F„(x) - <i>(x)| < 

a:GR 

(see §6 of Ch. Ill in [19]) where C is an absolute constant which by efforts of many 
researchers was optimized by now to a number a bit less than 1/2. 

Motivated partially by the research on nonconventional ergodic theorems (the 
name comes from [8]) the study of nonconventional limit theorems was initiated 
in [12] . More recently a functional central limit theorem was proved in |14j for 
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normalized nonconventional sums of the form 

(1.2) = ^ E {F{Xiq,{n)),...,X{qe{n)))-F) 

Nt>n>l 

where {X{n),n > 0} is a sufficiently fast mixing vector valued process with 
some stationarity properties satisfying certain moment conditions, F is a con¬ 
tinuous function with polynomial growth rate and certain regularity properties, 
F = f Fd{^ X ... X /r), ^ is the common distribution of X(n)’s and qj{n) = jn 
for 1 < j < k while qj{n) for k < j < i are positive functions taking integer val¬ 
ues on integers and satisfying certain growth conditions. In this paper we derive 
Berry-Esseen type estimates for the convergence rate in such nonconventional limit 
theorems. 

During last 50 years central limit theorems were extended to weakly dependent 
sequences of random variables and to martingale differences and corresponding 
Berry-Esseen type estimates of the speed of convergence were obtained, as well 
(see, for instance, 0, m, [la, m and references there). We observe though that 
summands in nonconventional sums appearing in C2D are usually strongly long 
range dependent (even when X(n),n > 1 are independent) so the results for the 
weakly dependent case are not applicable here. Still, it was shown in |14j that under 
natural conditions nonconventional sums can be splitted into ^ subsums and each of 
the latter can be approximated by a martingale. We will show that, actually, in the 
arithmetic progression case qj{n) = jn, j = 1, ...,£ the whole nonconventional sum 
can be approximated by one martingale which will enable us to apply one of Berry- 
Esseen type results for martingales mentioned above. Still, in order to do so we will 
need to obtain appropriate asymptotic covariance estimates for nonconventional 
summands. We observe that when not all gj(n)’s are linear but, say, qj{n), j = 
k+1, ...,l grow faster, for instance, polynomially as in |14j then we have to deal with 
several martingales with respect to different filtrations which requires additional 
considerations described in the concluding Section [5] 

As (11.11) and more advanced results show Berry-Esseen type estimates (with 
an absolute constant) depend crucially on variances of the corresponding sums 
which appear in some form in the denominators of corresponding bounds. In the 
standard (conventional) setup the conditions which ensure linear growth in the 
number of summands of these variances are well known for stationary sequences 
since m- On the other hand, the limiting behavior of the variance in (O 
was not studied in [14] in spite of the fact that a meaningful central limit theorem 
requires the limit of Var^^v as —>■ oo to be positive. Some partial results in this 
direction were obtained in [12] and [10] . Ensuring positivity of the limiting variance 
and obtaining appropriate lower bounds for it is especially important in Berry- 
Esseen type estimates and we provide here a rather complete answer concerning this 
question. Namely, we show that under appropriate mixing conditions the positivity 
question for the limiting variance of can be reduced to the same question for the 
^dimensional process constructed of independent copies of the process X{n), n> 0 
which is pluged in the function F. If X{n), n > 0 is stationary then (in the k = £ 
case) this ^dimensional process is stationary, as well, and we can rely on the well 
known results concerning the latter (see [11] and the next section). 

The structure of this paper is the following. In the next Section [2] we describe 
precisely our setup and formulate our main results. In Section |3] we derive some 
auxiliary estimates. In Sections |4] and [5] we prove our main theorems. In order 
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to increase readability of the paper we do not treat the most general case in the 
main part and postpone extensions and generalizations till the concluding Section 
There we consider also the case of independent X(n)’s where without relying 
on martingale results but employing a more direct method we are able to provide 
substantially better estimates than in the general situation. 

2. Preliminaries and main results 

2.1. Setup and assumptions. Our setup consists of a p-dimensional stochastic 
process {X(n)}n>o on a probability space and a nested family of cr — 

algebras Pk,h ~oo < k < I < oo such that Pk,i C Pk',i' ii k' < k and I' > 1. 
As usual (see 0) the dependence between two sub a — algebras 0,% <Z P will be 
measured by the expressions 

(2.1) Wq^p{g,'H) =s\yi>{\\E{g\g) - Eg\\p : g e L«(0,'H,P) and ||g||g < 1} 

and we refer the reader to [3] for relations between various dependence coefficients. 
Set also 

(2.2) ZUq^piri^ — sup (P_oo,fc 5 Xk+n^oo) ' 

k>0 

Our results below can be obtained assuming that X{n) is measurable with re¬ 
spect to En,n without special assumptions on the function E beyond measurability 
similarly to m- Nevertheless, we prefer here the setup from [T3] which allows 
applications to dynamical systems. Thus, we introduce approximation rate coeffi¬ 
cients 

(2.3) Piq , r ) = suvWXik) - E{X{k)\Ek-r,k+r)\U- 

k>0 

We will not require stationarity of the process {X{n),n > 0} assuming only 
that the distribution of X(n) does not depend on n and the joint distribution 
of {X(n), X{n')) depends only on n — n' which we write for further reference by 

(2.4) X{n) ~ /I and {X(n),X{rL)) ~ 

where Y ^ g means that Y has /i for it’s distribution, denoted also /i = ^{Y). 

Next, let E — E{xi, ...,X£), Xj £ R*’ be a function on such that for some 
K, L > 0, K € (0.1] and all Xi, yi G K*”, i = 1,..., £, 

(2.5) |P(a;) - F{y)\ <K{1 + ELi “ 2/jI” 

and |P(a:)| <K{1 + ^*10 

where x = {xi, ...,xi),y = (yi, ■■■,yi). To simplify the formulas we assume a cen¬ 
tering condition 

(2.6) F = J F{xi, ...,xi)dg{xi)...dn{xi) = 0 

which is not really a restriction since we can always replace F hy F — F. Our main 
goal is obtaining Berry-Esseen and covariance type estimates for ^Ar(t), t G [0,T] 
defined in (11.21) (with F = 0). For each 6* > 0, set 

(2.7) y^, = \\X{n)\\l = Jlxfdf,. 

Our results rely on the following assumptions (similar to [l4]l. 
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2.1. Assumption. With d = {£ — l)p there exits oo>p,q>l, b>2,a,X> 
and S,m > 0 (these numbers will be called the initial parameters) with 6 <k — 


satisfying 

( 2 . 8 ) 

9{q,p, a, 1 ) = ^ n°'wq^p{n) < oo, 

n>l 

(2.9) 

K{q, 5, A, 1) = ^ r^{P{q, r)Y < oo, 

( 2 . 10 ) 

. , 1 1 r + 2 8 

^rn < OO.^hqi < OO] With 7 > - H-h “ 

0 p m q 


while conditions on a and A will be specified in the statements below. 


As in m it will be useful to represent the function F = F{xi ,..., xi) in the form 

(2.11) F = Fi{xi) + ... + Fg{xi, ...,xe) 

where for i < £, 

( 2 . 12 ) 

F^{xi, ...,Xi) = j F{xi, ...,xi)dfj.{xi+i)...dp{xe) - J F{xi, ...,xe)dfj,{xi)...dp.{xi) 
and 

(2.13) Fi{xi,...,xe) = F{xi,...,xe) - J F[xi, ...,xi)dp{xi) 
which ensures that 

(2.14) J Fi{xi,...,Xi-i,Xi)dfj,{xi) = 0'ixi,...,Xi-i. 

Next, assume that qj(n) = jn for j = l,...,k < £ while when £ > j > k we 
have qj{n + 1 ) — qj(n) —>■ oo and qj{sn) — qj-i{n) —>■ oo as n —>■ oo for each e > 0 . 
Following [14] we will use the representation 

k i 

(2-15) CAf(^) = ^ 6 .Af(*i) + ^ 


i=l 




n—1 


where for 1 < i < A:, 

(2.16) = -^'^^Fi{X{n),...,X{in)) 
and for i > k 

(2.17) 

The following result was proved in El- 


[Art] 


= -^^F,{X{qi{n)), ...,X{q,{n))) 

^ n—1 


2.2. Theorem. Suppose that Assumvtion \2. 1\ holds true with 6 = 2 and a = A = 0. 
Then the £—dimensional process {^i,Ar(t)}i=i converges in distribution as N ^ 
oo to a vector Gaussian process {??i(t)}i=i with stationary independent mean zero 
increments and covariances 


E{qi{s)r]j{t)) =min(s,t)Aj = hm -E( 6 .Ar(s)^i.tv(A)) 


‘c la. O 
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where Dij =0 if i ^ j and max(z,j) > k. This together with \2.15\) yields that the 
limiting variance exists and has the form 

lim Var^N(t) = lim Ef^lrlt) = ta^ = t{aQ + af) 

Af—)-oo Af —>00 


where 


= lim E(^^^^N{i)f = 

N—¥00 ‘ ^ 

2=1 


*A.i 

2=1 


iD 


^,3 




e i 

and af = lim E{ 'V' Ci,Ar(l))^ = A.i- 

N—^oo 

2=fc+l 2=fc + l 

Moreover, the process f,N{-) converges in distribution to the Gaussian process r]{-) 
which can be represented in the form r](t) = Yli=i ViiH) + Ei=fe+i Vi(f) which may 
have dependent increments. 


2.2. Statement of main results. In order to make this paper more readable we 
will focus on the case k = i and introduce several extensions in Section 6 (among 
them, results for k < £). In general, uniform Berry-Esseen type estimates can only 
be meaningful if the asymptotical variance cr^ = limjv->.oo is positive which 

can be seen already in (HD. Some conditions for positivity of were obtained in 
Theorem 2.3 from [lOj but the following theorem provides a substantially stronger 
and more general result. 


2.3. Theorem. Suppose that k = £ and that Assum,vtion \2. 1\ holds true with b = 2 
and a,X > 1. Let {Xi*i(n)}„>o * = 1, ■■■,£ be £ independent copies of the process 
{X(n)}„>o and set 

N 

= F(X(ii(n),X(2)(2n),...,X(^i(fn)) and Ejv = '^2^- 

n—1 


Then the limit 


= lim — VarUn 

n—^oo Tl 


exists. Moreover, a'^ > 0 if and only if s^ >0 and the latter conditions holds true 
if and only if there exists no representation of the form 


Zn = Vn+l -Vn,n = 0, 1, 2... 

where is a square integrable weakly (i.e. in the wide sense) stationary 

process. Furthermore, s'^ = 0 if and only if VarYipf is bounded in N and then for 
all N >2, 

VariN < CN-^ In^ N 
for some C > 0 independent of N. 


We observe that this theorem remains true with essentially the same proof also 
in the more general case k < £ described above. Actually, in this case cr^ > 0 
unless Fj = 0 for all j = fc -I- 1, fc -I- 2,..., £ p, x ■ ■ ■ x /r-almost surely (a.s.) (see 
Section [Oil . The above result reduces the problem on positivity of the limit¬ 
ing variance for nonconventional sums to the corresponding much more studied 
question concerning sums of stationary in the wide sense processes. If X{n), n > 
0 is a strictly stationary process then (n), {2n),..., X^^\£n))n>o and 
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i^(X(i)(n),X( 2 )( 2 n),...,xW(€n)), n > 0 are strictly stationary, as well, while un¬ 
der our condition p.4p these processes are stationary in the wide sense. Limit 
theorems for sums of the latter were widely studied. We observe that it is not 
possible to give useful (i.e. computable) positive lower bounds for the limiting vari¬ 
ance even in a general conventional situation of sums of stationary processes. In the 
nonconventional case the situation is more complicated and though some formulas 
for the limiting variances are given in |14j it is not possible to check directly when 
they are positive. Still, assuming that X{n), n > 0 are independent we provide in 
Section [5] some formulas for limiting variances which are easier to handle and to 
obtain estimates. 

2.4. Remark. Similarly to [14] the results of this paper can be applied to some 
types of discrete time dynamical systems T : O such as subshifts of finite type, 
expanding transformations and Axiom A diffeomorphisms considered with a Gibbs 
invariant measure fi (see, for instance, lai)- Such dynamical systems are exponen¬ 
tially fast '(/j-mixing which is more than enough for our purposes. In this setup we 
should take X{n) = f o T" where, say, / is a Holder continuous (vector) function. 
Then Theorem IQ reduces the question on positivity of the limiting variance of 
^■'/"EliG(T"a;,T 2 "a;,...,T^-cc), where G(cci,..., w,) = i^(/(a;i),...,/(w,)), to 
the corresponding question for the product dynamical system T x x ■ ■ ■ x : 

O, i.e. for G(T”wi, T 2 "w 2 , - Since TxT^x ••• xY 

preserves the product measure ji x ■ ■ ■ x fi and also turns out to be an exponen¬ 
tially fast '0-mixing dynamical system we arrive at a well studied problem. Fur¬ 
thermore, it is known since [5] that for a general measure preserving dynamical 
system T : H O and a bounded measurable function H the sums 
are almost surely uniformly bounded if and only if H has a co-boundary represen¬ 
tation H(u}) = ip(Tuj) — (p{uj) for some other bounded measurable function Lp. For 
nonconventional sums G{T'^uj, ...,T^"a;) such result cannot hold true in this 

generality since the meaningful action here is only on the diagonal of H x • • • x H 
and its images under T x x • • • x T^, and so we can define G to be a co-boundary 
for T X X • • • X on the diagonal and its images which has zero product measure 
while defining G arbitrarily outside of the diagonal still preserving measurability. 
Then the sum will be bounded but G will not have necessarily a co-boundary repre¬ 
sentation on the whole product space. Such simple counterexample will usually be 
impossible if we impose some regularity conditions on G, even just continuity. In 
the more restricted nonconventional situation of Theorems and 12.31 the central 

limit theorem together with positivity of the limiting variance ensures that the sum 
^^^1 G(T"a;,..., T^^w) is unbounded while if it is bounded then G must have a 
co-boundary representation. It would still be interesting to understand whether 
boundedness of these sums in the nonconventional setup can be characterized in 
a more general situation. In clarifying some points discussed in this remark the 
second author benefited from several conversations with A. Katok at PennState 
University in September 2014. 

Recall, that the Kolmogorov (uniform) metric is defined for each pair of distri¬ 
bution functions F, G by 

(2.18) ^^(F, G) = sup |F(a;) — G(a;)|. 

Now we can formulate our second main result. 
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2.5. Theorem. Suppose that k = £ and that Assumvtion \2. 1\ holds true with b > 4, 
a, A > 1 and that > 0. Then, 

dif(£(e^(l)),Ar(0,ah) < 

where, A/'(0, cr^) is the zero mean normal distribution with the variance > 0, the 
constant C > 0 depends only on the initial parameters and the expressions ifOl) 
and i2.9\} . A{a) = (1 + i) max(tT“3, cr“5) and 

C(a, ^ min(min(a, A) - 1, y^)- 

Moreover, if there exist c € (0,1) and r > 0 satisfying Wq^p{n) + /3{q, n) < rc'^ then 
j^f-CiaA) caTT. be replaced by N~^ In N. 

In order to describe our method of the proof of Theorem [2^ consider the simpler 
case when X{n), n > 0 is a sequence of independent identically distributed (i.i.d.) 
random variables and choose the cr-algebras iFn,m = a{X{n), ...,X{m)} for any 
n < m. For each i = 1, 2, ...,£ define 

Mi^n = Fi{X(rn), X(2m),X(im)) for n < iN 

im<n 

and Mi^n = for n > iN. Then n = 1,...,£N is a martingale with 

respect to the filtration n > 0}, and so ^i,n, n = 1,2, ...,£N 

is also a martingale or, more precisely, a martingale array since the construction 
depends on N. Now observe that ^ 7 v(l) = and Theorem 12.51 will follow 

in this situation from estimates of rates of convergence in the martingale central 
limit theorem derived in [9]. Still, for this specific i.i.d. case we will give in Section[6] 
another more direct proof which yields better estimates. In the more general setup 
of the present paper we will need first a truncation procedure and then a martingale 
approximation similar but still somewhat different from |14j . Namely, as above in 
the i.i.d. case, we construct in the case k = £ a martingale approximation of the 
whole sum •\/]V^Ar(l) and not only of its parts VNfi.Nit) as in [14]. Some additional 
work, described in Section m is needed when has the more general form (HID 
with some of qj (n) ’s growing faster than linearly. In order to rely on we will need 
also appropriate quadratic variation estimates which will be obtained in Section [Sj 

2.6. Remark. We construct a martingale array approximation (representation in 

the i.i.d. case described above) for the whole normalized sum CAr(l) and not only 
for its parts as in [14]. This serves us well for the Berry-Esseen type estimates 
here and yields also the central limit theorem for £,n{^) from standard results for 
martingale arrays. Still, the functional central limit theorem for the whole process 
f.N{t), t > 0 cannot be obtained this way. Indeed, if we could approximate this 
process by a martingale array depending only on N but not on t then the limiting 
Gaussian process would have independent increments which is not the case in gen¬ 
eral (see [B]). Already in the above construction for the i.i.d. case we would have 
to define [ijvt] for n > [iNt] obtaining martingales depending on t which 

would not enable us to employ standard theorems on martingale arrays. 

3. Auxiliary estimates 
We start with the following simple observation. 
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3.1. Lemma. Let f : —)> K and g : —>■ R satisfy the conditions i2.5]} and 

Then the function h : (R^)‘^+p —>■ R defined by h{x,y) = f{x)g{y) satisfies 
these conditions with constants 2t, k and K = 2(1 + d + p)K^ in place of i, k and 
K, respectively. 

Proof. The lemma follows from three simple inequalities \ab\ < 5 ( 0 ^ + b^), |a| < 
1 + o^, \ab — a'b'l < \a{b — 6 ')| + \b'{a — a')|, the Holder continuity of / and g and 
the concavity of the function a; —>■ a;“ for 1 > a > 0 . □ 

Next, we will need 

3.2. Lemma. Let 0 < 6 < k < 1 and b > 1 satisfy > ^ + | for some 

q,p> 1 and m, 6 > 0. Then for any random variables Y, X, 

||F‘-^1k<(i + ||x||^)||r|L.||x||^. 

Proof. First, clearly, 

(3.1) ||F^X«||6 < Ti+T 2 where 

Ti = ||y‘X«I{|x|>i}lk and T 2 = \\Y^X-^x\<i}\\b. 

Observe that Ti = • (I{|v:|>i})‘^||b- Since ^ | then Lemma 3.1 from 

[l4] yields that 

Since ||I{|x|>i}||i? = (-P{|^l > 1})’ = (^’{l-^l'^ > 1})’ it follows by the Markov 
inequality that ||II{|x|>i}||g < Moreover, since ( 7 ^)“^ = 

IF + ^> Lemma 3.1 from [M] yields < ||T|L||X||;)„ and so Ti < 

II^^ILII^IKkll^llr Next, set Z = |X|I{|x|<i}. Clearly, T 2 = Since 

0 < .Z < 1 and (5 < K it follows that T 2 < ||y‘Z‘*||{,. Since | ^ we 

apply again Lemma 3.1 from El and use that \\Z\\q < ||X||g in order to obtain 
T 2 < I|L^II) 7 iI|N 1 ||^. The lemma now follows from (13.11) and the above estimates. □ 

We will use also 

3.3. Lemma. Let X, Y and Z be random variables and 5 > 0. Suppose that X and 
Y are defined on a common probability space and Z has density bounded by c > 0. 
Then, for any a > 1, 

dK(Y,Z)<MKiX,Z) + \\X-Y\\i^{l + Ac). 

Proof. Let a, t G R and <5 > 0. Then, 

(3.2) \P{Y <t}- P{Z < t}\ < dxiX, Z) + \P{X <t}- P{Y < t}| 

< dK{X, Z) + P{\X - t| < 5} + P{\X - F| > (5}. 

By the definition of dk{X, Z) and the mean value theorem, 

P{\X -t\<5)<P{t-25 <X-t<t + 25) = P{X <t + 2S)- P{X <t-2S) 
< 2dk{X, Z) + P{Z <t + 25)- P{Z <t-2d)< 2dk{X, Z) + Ac5. 
Therefore by the Markov inequality, 

\P{Y <t}- P{Z < t}| < Mk{X, Z) + 4c<5 + ^ 

The lemma follows first by taking supremum over t G M. and then taking S = 

||x-y|U^. □ 
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Next, we introduce notations which appeared in [14] and will be useful here, as 
well. Set 

(3.3) (^1, • ■ •, ^i—1 j —1, (u) ) \J~ , 2 —r,n+r ), 

=i^,(X(gi(n)),...,X(ft(n))) 

and Yi^rn =0 if m ^ {qi{n)}n=l, Xr(n) = E{X{n)\Xn-r,n+r), 

(n) ,r — ^i,qi (^r (^l (^))5 X^ (jl) ) , Uj) and — 0 if 777. ^ {^7 (^)} n—1 ' 

We will rely on the following result obtained in Lemma 4.2 of m under As¬ 
sumption [O] with 6 = 2. Set 

67,j(77,/) = 

and 


Si,jin,1) = min{qiin) — qjil),n) and Si,jin,l) = iiiax.isi,jin,l), Sj,iil,n)). 

Then, there exits a nonincreasing sequence him), satisfying 

(3.4) sup |6ij(77,1)1 < 6(m). 

Moreover, for m > Li we can set him) = Ciwq,pin) Y I3iq,n)^) with n = [^ 777 ] and 
some positive constants Li and C depending only on the initial parameters. 

Next, we will obtain estimates of errors for approximating expectations of the 
form EGiXini), ...Xing)), where 77i < ... < ng, by corresponding expectations 
with respect to corresponding product measures. The result is similar to Lemma 
4.3 from |14] but the latter does not provide specific estimates which we need here. 
First, we will recall the inequality (3.14) from Corollary 3.6 of [T3]. Let Q and TL be 
sub-cr algebras of a probability space (fl, P), X be d-dimensional random vector 
and / = fix,uj), cc G be a collection of random variables that are measurable 
with respect to Ti. which satisfy 

(3.5) \\fix,u:)-fiy,uj)\\q < Ciil + \x\‘-+ \y\‘-)\x-y\'^ and ||/(a;,a;)||, < C 2 il + \x\‘-). 

Then, assuming that ^ > ^ -|- -I- | and 1> k> 0 > 

(3.6) \\E{fiX,-)\g) - gix)\u < cwq,pig,n)iCi+C2)^cl~^iiY\\x\Y+^) 

+2c(Ci + C' 2 )(l + 2||A||(+2)||W - E{x\g)\\l 

where c = cio, K,9,p,q,a,6,d) > 0 depends only on parameters in brackets and 
gix) = Efix, to). Assuming that a > 1, taking expectation and using the Holder 
inequality together with (13.61) we obtain 

(3.7) \EfiX,-)-EgiX)\<R 

where R is the right hand side of (13.6p . As a conclusion of (j3.7l) we derive the 
following result. 

3.4. Lemma. Suppose that Assumption 2.1 holds true. Let G : (IRp)"i+" +"" —M 
be a function satisfying conditions lOI) with K',k and t! < bi. Suppose that 
the sets Mi = { 07^1 < ... < ai,ni} C N satisfy ai,rn < 07+14 set XiMi) = 
(A(a 7 .i),..., A(a 7 _„J) where i = l,...,u and r = min { 07+14 — 07 _„^}. Let 
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{Ybe independent copies of{X{Mi)}^^^. Assume that 1 > ^ + + |- 

Then 

(3.8) 

\EG{XiM,), X(M„)) - EG{Y{M,), r(M„))| < C((/3(g, [J]))^ + 
where G depends only on the initial parameters and on maxj{ni}, v and K'. 

Proof. For i = 1 ,v set Zi = 

X, = and z,) = Gizi,z,). 

Define recursively for j = v,v — 1, 

= J H(-^\zi,...,Zj)diy,{zj) = EH^^\zi,...,Zj.i,X{M,)). 

Notice that = EG{Yy). For any s > 0, set 

ilp-(zi,..., ) = EH(^^ (zi, ..., z,_i , X[ .] {M,)). 

Observe that since m > bi, X{Mj) has a finite d moment. Hence, Hr^'^ also 

satisfy conditions dm)-(ESI). Thus, by the contraction of conditional expectations 
and Lemma 13.21 we obtain, 

\EH(^\X,) - < G{fiq, [^]))^ 

and 

< Gifiq, C-])f. 

Let 1 < j < w and set f{y,uj) = E[^^\y,X^iz^[Mj)). Observe that condition (13.511 is 
satisfied with constants which depend only on the initial parameters since X{Mj) 
has a finite bqi moment and qd < bqu. Taking Q = E-oo^aj-i i+[5] applying 
(ITTI) we obtain that 

\EH^^HX,-uXy^{M,)) - + /3(g, [^]))^) 

and therefore, 

\EH^^\X,) - EH‘^^-^\X,.d)\ < C"K.p([^]) + ^(g,[^]))^]. 

Finally, using the fact that 

V 

H^'’HXy) - H^°'> =J2 h^^\Xj) - 
i=i 

we obtain (13.81) completing the proof. □ 

We will need the following general estimates which appeared as Lemmas 6.1 
and 6.2 in earlier preprint versions of [2] (see arXiv:1012.2223v2) but not in its 
published version so for readers’ convenience we provide them here. Consider a 
probability space (dl,E,P) with a filtration of cr—fields Qj. Suppose that random 
variables Xj are Qj measurable and for some 2 < p < oo satisfy 

(3.9) 7 p = sup||Xj|lp < sup^ ||£'[Xj|t/i]||p = Hp < oo. 

7 * v. • 
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We will explore the behavior of higher order moments for sums Sn — 
obtaining estimates of the form E[S'^] < C 2 in’' with some control on dependence 
of constants C 21 on 72 / and A 21 . 

3.5. Lemma. Suppose {a„} is a sequence of nonnegative numbers such that for 
some integer I > 1 and any integer n>l, 


n 21 

^n +1 ^ C EE c 

i=l r=2 




Then 


< An^ 


with A = max{2‘c‘C^‘,C^\ai}. 


Proof. We derive the above inequality by induction. It is clearly valid for n = 1. 
Assume it is valid for j = 1, 2,..., n. Then 

au+i<cEU^r=2CHAff-^ 




where 


21-2 


A' = cC^A^-t C’^A- 


r—0 


and we need to pick A so that y < A. In particular, A = max{2^c^C'^^,ai} 


A' < /I Tv, vv„v.r;v..,i„v. /I _ r<2i 

will do because CA~^ < 1 , 2 cC'^A“t < \ and 
21-2 

cC'^A^-t A^-t{ 21 - 1) < cC^A^-hl <IA. 

r—0 


□ 


3 . 6 . Lemma. Let the sequence {Xi} of random variables satisfy SS. .91) with p = 21 
and some positive integer 1. Then there is a constant ci depending only on I such 
that 

<ciAl\nK 

Proof. We begin by expanding = {Sj + by the binomial theorem, 


21 


Sf+^ = Sf + 2lSf-^Xj+i + ^ 


r=2 


21 


Qzl — r Y'T 


and expressing 


21-2 


sf = IPS'-' - sf-,') = E -T. E srsfi 

i—1 r—0 

This enables us to rewrite 

Sf^,=Sf+2l Y: Z,X,^i+Y 

l<i<^' r—2 

where Z, = W ErL”o" Then, 


02/ —r -\rT 
^3 ^i+1 
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— r -\rr 

i+1 


ESl^^,=EXf^ + 2l 

l<z<j<n j=l r—2 ^ 

= 2' E 25Z.W + i:i;P')i5Sf-"Jf, 


l<'i<n 


r^2 


L-r vr 

^j+1 


where Wi = Y.]=i E{Xj+i\Ei). We note that \\Xi\\ 2 i < 72 J < A 21 . and || Wi|| 2 / < A 21 . 
Hence, 


21-2 

E[\zm\] < II ^ S^SfLl^-^W^jX.himhi 

r—0 

<ciAU{ESr)^+{ES!L,)'-^). 

Next, for r > 2, 

\Esf-^x^^,\< \\s,\\fr\\x,+,r2^ < A^2i\\Sjf^r. 

It follows that 

n 21 

X/ (X/^Sill'S'ill^! ’" + "42i||*5'jll2Z ^ + ^2/ll'S'i-l|l2Z 

i=l r=2 

( n 21 \ 

EE^^^ii^.iirn 

j^l r^2 ^ 

where c/ is an absolute constant which depends only on 1. The sequence a„ = E[S‘^^] 
satisfies the condition of Lemma 13.51 with c = ci, C = A 21 and ai < 7 I; and the 
result follows. □ 


< Cl 


''n+l 


4. Limiting variance 

In this section we will prove Theorem 12.31 For each i = set 

and = Yn=i Ei,n so that Z„ = YLi Ei,n and E^v = YLi Ei,N- Then, under 
the assumption (12.41) the processes {Zi^n}n>Q, i = I,...,!* and {Zn}n>o are (one 
sided) stationary in the wide sense. In view of (12.141) . 

e 

(4.1) EZi^nZj^m = 0 A i ^ j and so VarEjv = E Var(Ei^jv). 

i=l 

Hence, EZnZo = EZi^nZifi. In the same way as Lemma 4.2 of [14] provides 
the estimate p.4l) with h{m) = C{vUq^p{[^m]) + I3{q, [^m])"^) for some C > 0 and all 
m large enough we obtain that for all n large enough and some C > 0 independent 
of n, 

\EZ^^,Zo,^\ < C{wq,p{[^n]) + Piq, [in])^). 
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This together with Assumption 12.II with a, A > 1 yields that 

OO 

(4.2) ^n|A(Z„Zo)| <oo. 

n—1 

By Proposition 8.3 and Theorem 8.6 from [4] (modified for a one sided process) 
if a stationary in the wide sense process satisfies (IQ) then = lim„_>.oo ^Varl]„ 
exists and VarE n is unbounded if and only if > 0 which is equivalent to the fact 
that there exists no representation of the form = Vn+i — 14, where 14,, n > 0 is 
a square integrable stationary in the wide sense process. These together with (SH) 
implies that = 0 if and only if Var(Ei^Ar) is bounded for each i = 1, 

Next, set 

N N 

Sn = ^F(A(n),...,X(€n)),5,.^ = ^ F,(A(n),..., A(m)), 

n—1 n—1 


N, = = [Nil - ^)] + 1 and ivf = ^ 


~ ^ ^ 1,2,3,... 


S^N = Si,N = Y. Win), ...,X(£n)) 


N 


and 




E FeiXin),.:,X{£n)),S^^i^ =S^%- 


(2z—3) _ 0 ( 22 — 1 ) • _ no 

^ — -'-5 


n—1 


Set also ajf = variSN) and s% = nar(Ejv). 
Now we can write 


(4.3) 


ah = XaiiYiJi St,N + + Var(S')J^j^) 

+2Cov(Et( S,,N + 5))^, sfY- 

Observe that Nt> Since £m — in>^- whenever i < £, n < N and < m < N 


then \bi^iin,m)\ < /i([y]) by (13.41) . Taking into account Assumption 12.11 with 
a, A > 1 and the choice of the nonincreasing function h we obtain that 

(4.4) |Cov(EE^^^> < EtlEn=iEZ=N, Kiin,m)\ 

< £N'^hi[Y]) < nhin) < 00. 

Furthermore, since \bejin,m)\ < him — n) when n <m we obtain 

(4.5) |Cov(5))^, < EE' Km -n)= Kj) = 

EfE E:ESS.i) Kj) = iN - N,)hij) + jhij) 


+ Y.^^N,-ii^ - j)Kj) < YKT=ijKj) < OO. 


Next, define for j = —1,1,2,3.... similarly to S^h using 

A(^)(n),..., X^^\£n) in place of A(n),..., X(£n). Observe that — ^) + 1 > 

> a)*~^^( 1 — A) for any i,j < £ and so. 


U) 
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Applying Lemma 13.41 for 

G{X{n, m),X(2n, 2m), ...,X{£n, £m)) = F(,{X{n),X{ln))Fi{X{m), ...,X{£m)) 
where > n,m> we obtain taking into account (14.611 that 

\EFt{X{n ),..., X{£n))Fi{X{m ),..., X{£m)) - EFi{X^^){n ),..., XW(£n)) 
xF,(A(i)(m),...,xW(£m))| <C7([^^]) 

where 7 (n) = Wq^p{n) + n) and C > 0 depends only on the initial parameters. 
Hence for all i > 1, 

(4.7) |Var(5l";)) - Var(E(2;))| < 

< 64(7sup„>i < 256(7^^^ nj(n) = a 

where = N and Ci > 0 depends only on the initial parameters and the expres¬ 
sions (12.81) and (1^ . 

Next, assume that is bounded. Then by (14.11) we see that Var(Ei_Ar) is 
bounded in N for each i = Proving one direction of Theorem 12.31 we will 

derive from here by induction in j that for each j there exists Cj > 0 such that for 
all N >2, 


J 

(4.8) Var(^ Si^N) < Cj In^ N. 

i^l 

When j = 1 we have VarS'i_ 7 v=VarEi_ 7 v which is bounded if is bounded. Now 
suppose that (14.81) holds true for all j up to ^ — 1 and prove it for j = £. Recall 
that Zi^n, n > 0 is a stationary in the wide sense process, and so 


n)' 

Var(E^^^) = Var( ^ Z^,„) = VarE^_^o-i)_^w 

n=N)''> 

and the latter expression is bounded in view of our assumption on s^. This together 
with (liTll yields 

(4.9) Var(^j5) < Var(E^^) + Ci < C 2 

for some C 2 > 0 independent of N. Now by (I4:3l)-(l43t. (l4J]l and the induction 
hypothesis 


t 

(4.10) all = Var(^ S,^n) < cg + 2(7f_i In" N + 2Var(5^_^^) 

1=1 

for some cg > 0 independent of N. 

Next, applying the above definitions recursively for any i such that > 2 we 
can write 


(4.11) 


c(l) _ c(3) _j_ c(4) _ q{2i—l) 


EsJ: 

i=2 


(2j) 
N ■ 


i 


Hence, 
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where we use that (E^i By (|4.6I1 we can choose i = MlnN 

for some fixed M > 0 so that 2 < < i + 4. Then VarS'j^j^”^^ < C'(l + In^(iV)) 

for some C' > 0 independent of N and we obtain from (14.91) that VarS'j^j^ < 
(7(1 + In^ N) for some (7 > 0 independent of N which together with (14.1011 yields 
(ra with j = i. 

Next, we will prove Theorem 12.31 in the other direction assuming that is 
unbounded which, as explained above, is equivalent to the linear in N growth of 
and to the fact that the corresponding limiting variance is positive. Our goal 
is to show that then 

(4.12) = lim > 0. 

N^oo fy 

Recall, that the existence of the limit in (14.121) follows from [14] and only its posi¬ 
tivity should be proved in our situation. The proof will proceed again by induction 
in i. For I = \ we have 5 "at = Ejv, and so if VarE^r grows linearly in TV then 
the same is true for Var5'Ar. Now suppose that we already established for each 
j = 1, 2,..., £ — 1 that if Var(^^^^ E^^Ar) grows linearly in N then the same is true 
for Var(^'(^j^ Si^yi') and now we will prove this for j = £. Indeed, assume that 
=Var(X;Li S i,Af) grows linearly in TV. Then by (14.11) either Var(^^^]^ ^i,n) or 
Var(E^^Af) grow linearly in TV. In the latter case we obtain also that Var(E) grows 
linearly in TV in view of stationarity in the wide sense of Zg^n, n > 0. Then by dUZI) 
we see that Var(S'j^j^) grows linearly in TV. This together with (I4.3I) - (I4.5I) yields 
that cr^ grows at least linearly in TV but since by |14] a (finite) limit limAr_).oo 
exists we conclude that in this case grows linearly in TV as required. 

Now suppose that Var(E^_Ar) is bounded while Var(^^^^ E^^a^) grows linearly in 
TV. Then Var(E^^^) for all i are also bounded by stationarity of Zg^n, u > 0 in the 
wide sense which together with (14.7p yields that Var(S']^^^) are also bounded for 
all i. Using again the representation (|4.11l) we conclude as before that Var^]^^ < 

(7(1 -I- In^ TV) for some (7 > 0 independent of TV. Since Var(^^~| E^^at) grows 
linearly in TV then by the induction hypothesis Var(y^^_^ grows linearly in 

TV, as well. It follows that 

(4.13) a% = Var(X;i=i ^^,n) = Var(X;f=| S^^n) + VarS'^^Af 

-f2Cov(X)iIi^ Si^N,Sg^N) > Var(X)il| -Si, at) 

-2(Var(X;iIi Si,Ar))^^^((VarS^_’j^)i/2 

> Var(Sf-^ S,,iv)(l - (7TV-i/2(lnTV + 1)) 

for some (7 > 0 independent of TV. Hence, cr^ grows at least linearly in TV but, again, 
since finite limit limAr-ioo exists aff grows, in fact, linearly in TV completing 

the proof of Theorem 12.31 □ 


5. Convergence estimates 

In this section we introduce martingale approximation technique which is similar 
but a bit different from |14] . Then we study the quadratic variation of the con¬ 
structed martingale and use it to prove Theorem [231 The following representations 
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from (5.2) in [14] will be useful here, as well. 

(5.1) Yi^n = Yi^n,l + — h^z,n,2’—i]) Ci,N,oit) = Yl<n<Art 

Ci,N,r{t) = Yl<n<7vJ^.".2'- — Yi,n,2’--At ^ Ij Ci,jv(^) = 12r=0 Ci,N,r{t) 

and ^i,Ar(t) = Yr=0 Ci,N,r(t) = J2l<n<Nt ^i,n- 

The convergence of series in (15.11) follows from [14]. Similarly to Proposition 5.8 
of [14] we derive from Corollary 3.6(ii) there that for any rGN, l<i<£ and 
I <n + r, 


(5.2) 


\\E{Yi^nA^-oc,,l)\\b < Cr{n - 1) 


for some sequence satisfying 

OO 

(5.3) Cr = Cr{m) < Cr 


m—0 


where b comes from Assumption 12.11 and, recall, that 6 > 4 in Theorem 12.51 while 
C > 0 depends on the initial parameters and on the expressions (12.8p and (12.9p . 
Furthermore, similarly to the proof of Proposition 5.9 from |14j we obtain that 


(5.4) 


^ sup II sup \Ci,N,nit )\\\2 <CT ^ Wiq^n))^ 


where C > 0 depends only on the initial parameters and the expressions 
([21]). Observe that since 

OO OO 

A{q, n)Y < m~^ n^Aiq, n)A 

n—m n—m 

then under Assumption 2.1 with b> 2 we obtain from (15.41) that 
(5.5) II sup - &t)\ II2 < CT2-“^ 

0<t<T 

where C > 0 depends only on the initial parameters and the expressions 

(El]). 


and 


and 


5.1. Martingale approximations. For any fixed n,u€N and 1 <i <£ set 

hF,i,n,2^ — h^,n,2“ 4“ Ei^n,u Ei^n—l^u 

where = Ys>t,+i £'(^i.s, 2 “|-^-oo.«+ 2 “). Clearly, {Wi,„, 2 “}n>i is a martingale 

difference sequence with respect to the filtration {J^-oo,n+2“}n>i. For any 1 < 
i < £ and u{N) = define the truncated martingale differences = 

I{n<zW}iFi „ 2 “(^) and = Yi=i where = 1 if an event A occurs and 

= 0, otherwise. Set and 

Tl ^ 

m—l i—1 

When N is fixed the sequence n > 1 is a martingale with respect to the fil¬ 

tration {£F_^ n-i- 2 '‘('^) }ri>i and when N changes we have a martingale array. Taking 
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into account that ^N{t) = Ei=i obtain by (j5.3L (|5.4p and (|5.5I1 that 

(5.6) \\^n{1) - < C{N-^^ +N-^) 

where C > 0 depends only on the initial parameters and the expressions ()2.8I) and 

(1^ 


5.2. Quadratic variation estimates. Our goal in this subsection is to obtain the 
following result. 


5.1. Proposition. Suppose that Assumvtion \2.1\ holds true with a,X > 1. Let 
1 < * < J < ^ o-nd set 


Then 

(5.7) 


1 


iN 


- ^Zn-iD,J\2 < 


where Dij was introduced in Theorem l£.SI and C depends only on the initial pa¬ 
rameters and the expressions i2.8\} and 113). 


We prove this proposition in several steps formulated as separate lemmas. 


5.2. Lemma. Let 1 < i < i- Suppose that {nk}'^i is a strictly increasing sequence 
of natural numbers. Then, for any u,m, k £ N such that k < ^, 

i?+m—1 p+m—1 

II E ,ins , 2 '“ \ \ 2 k 1 II E h ,ins 11 2k < C^/m 

S — V S—V 

where C depends only on the initial parameters and the expressions 

Proof. Let s > s'. Taking l,n £ N which satisfy I > {i — l)n and in > / + 2s we 
can derive from Theorem 3.4 in [14] that 

||£’(L),i„,s|J'_oo,i+s) - E{Y,^in^s'\^-oa,i+s)\\b < CiWq^p{in-l - 2s){l3{q,s')Y 

for some Ci > 0 depending only on the initial parameters, (see the proof of Lemma 
3.11 in the early preprint version arXiv:1012.2223v2 of [14]). On the other hand, 
if Z < (i — l)n and 2s < n then by the contraction of the conditional expectations 
similarly to the above, 

' |•^-oo,^^-s)||b < ||.^(hiyn,s — 00 ,( 2 —l)n+s ) 116 

< C 2 TUq^p{n - 2s){l3{q, s'))"^ 

for some C 2 > 0 depending only on the initial parameters. Let k,r,m £ N and set 
s = 2’'“''^, s' = 2'", I = ium and n = Uk- Since — Uk' > k — k' ii k > k' there 
exist no more than 4s = 2’’+^ natural numbers k > m which do not satisfy either 
inm ^ (i — i)nk and ink > Wm + 2’’+^ or ium < (i — l)*^fe and > 2’’+^, i.e. for 
each m we can use one of two inequalities above with such s, s', I and n = Uk > Um 
except for at most 2’’+^ of fc’s. Using again Theorem 3.4 from [M] (or Lemma 3.12 
from the above mentioned preprint), the contraction of the conditional expectations 
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to bound those (at most) 2’'+^ summands, the estimates above and the fact that 
< oo we obtain 

sup ^ l - Y,^^n,M^^n^+ 2 ^+^)\\b < 0 ^ 2 ^ iPiq, 2 ^)f 

"* /c>m 

for some Ca > 0 depending only on the initial parameters and the expression (12.81) . 
Applying Lemma 13.61 with 

= h;,, 

yields for k < ^ that 




v-\-m— 1 


(5.8) 


^ {P{q,2-)Y 


for some C 4 > 0 depending only on the initial parameters and the expression (12.81) . 
Since = Yi.ins + then we obtain for any u > 0 

that 

n+m —1 00 n+m —1 

(5-9) II ^ hi,ms,2“l|2fe < rm,,r)f + \\ J2 Yun.U- 

s—v r—u s—v 

Since Yi^i^ = Yi^in,i + Y^i(h),m. 2 ’- - h)_i„_ 2 ’-i) almost surely then by (lOl) and 
(15.21) applied with r = 1 together with Lemma (SHI applied with we 

obtain || bi_iji^|| 2 fc < C^/m and the present lemma follows by (j5.9|) . □ 

5.3. Lemma. Suppose that Assumption 2.1 holds true with a,X > 1. Let 1 < i,j < 
e. Let NeN. Setl = 1{N) = [iV^], Ni = [f ], 

VN,r = K = ( ^ h)_„_2'‘('^))( X! ^i.n.2"(JV)) 

n^Br n^Br 

and Ur = Vr — EVn^t, where Br = NP|(^(r — \),lr]. Then, 

1 


^^C/7V.r||2<C7V-l“- 


"TV 

r—L 

where C depends on the initial parameters and the expressions i2.8\} and i2.9]} . 
Proof. For any 1 < r < Ni set 

Ar = {1 < r < Ni : min{|sri — tn\ : 1 < s, t < , n G Br, n G Br'} < 1 }. 

If for some 1 < t,s < sr'l < t{r — 2)1 or s{r' — 1)/ > t{r + 1)/ then for 
any n G Br and n' G Br' \tn — sn'\ > 1. Hence, for any r' G Ar, there exist 
1 < t,s < satisfying sPl > t{r — 2)1 and s(r' — 1)/ < t{r + 1)1. Therefore, 
|r' — ^1 < max(^, ^ + 1) < 2£ and hence \Ar\ < 4£®. Next, 

Ni Ni 2 Ni 2 

(iiEt^-ii2)'=E^( E E^( E 

r=l ri = l i- 2 GAri fc=l ri=l r'i^A^.^ k=l 

First, for any 1 < ri,r 2 < TV;, by Lemma |5.21 and the Cauchy-Schwarz inequality, 
\E{Ur^Ur 2 )\ < ||HrJ| 2 ||Hr. 2||2 < CTV and hence, 

Ni 


- /V E 1^’'! - ./a7 “ ./w' 


VN y/N' 


(5.10) 
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Next, let 1 < ri,r2 < Ni and suppose that r2 ^ Since ri ^ Ar 2 assume 
without loss of generality that ri < r 2 . Now we estimate \E{Urj^Ur 2 )\- First, by 
(EUl) = Yi,n + J27Lu Thus, for s = 1, 2 the Cauchy-Schwarz 

inequality. Lemma 15.21 and (I5.8|) imply that 


||h-s halb < II EneS,, EnGBr (hi,'"- ^,>.2“ ) | U 


<IIE 


n^Br 


Y, 


j,n,2-“ 


I EnGB. - ^*.".2^114 < ClVE2-“W^ 


where 

Vr = ( Yi^n)i Yj^n)- 

Tl^Br Tl^Br 

Hence, by the above. Lemma 15.21 and the Cauchy-Schwarz inequality. 


(5.11) ||h,K,-i4,i4j|i< ||fo.j|2||H.,-L;j|2 + ||y.,||2||v;,-fo.j|2 

< C'2iV2-“W^ < CsN^-^. 

In view of (I5.11L it suffices to estimate cov(Vr^, Vr^)- We show that Lemma 15^ is 
applicable. For any ns,ins G s = 1,2 observe at F),niFj,"*ih,n2E,"*2- Then 
it vanishes unless i divides Ug and j divides mg for s = 1,2 and we can write 
ni = in'i,n2 = W2 , toi = jm'i,m2 = jm' 2 . 

Set 


71 = ({s«'i}s=i U and 72 = U {sm^Yg^i). 


By ordering the set 71 U 72 and considering the jump points from 71 to 72 (or vice 
versa) we can represent this set as a disjoint union of blocks with distances between 
them at least and which are contained in 71 or in 72. Applying Lemma 13.41 first 
with Yi^niYj^rniYi^n 2 Yj,m 2 and then with and Yi^n 2 Yj,m 2 separately yields 


\E{Yi^niYj^rniYi^n2Yj,m2) “ E{Yi^iniYj^mi)E{Yi^n^Yj^jn2)\ < 

where 7(71) = vjq^p{n) + {j3{q,n)Y. Finally, by (I5.11|) . the fact that < 

^^-(min(a,A)-i) |.]^g above inequality we see that 

111 / A ^ (niin(Q:,A)-l ^ 


(5.12) ^|j2|<C5(lV-^+iV- 

and the lemma follows by (I5.10|) - (I5.12|) . 


□ 


5.4. Lemma. Suppose that Assumption 2.1 holds with a,A > 1. Let N € N and 
^ Y h j Y i. Then 

1 ^ 

II—^(Z„-£;(Z„))||2 < 

n—1 

where C depends only on the initial parameters and Zn = is defined in 

Proposition 15.11 

Proof. Fix N gN and let I = [a/E], u = u{N). For any r > 0 set t/r = .F_oo,ri+2", 
Gr = i J2 W^*.».2-)( ^ VF,,„,2-) and T, = G, - E„gb. 

n^Br n^Br 
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where Br is defined in Lemma 15.31 Clearly {Tr}'^i is a martingale differences 
sequence with respect to the filtration {Gr}'^i- Then by (I5.2L the triangle in¬ 
equality, the Cauchy-Schwarz inequality, Lemma 15.21 and using the fact that 6 > 4 
and 2 " < ^/l, 


(5-13) \\Gr ^ IKYrtGB^ ) 112 + 

W-..n.20(E„6B. - W ., n , 2^)\\2 < CiV/2“ < 02 ^ + ^^ 

and hence 


Ni 


\\Y.iGr-Vr)\\2<C2N- + —^. 

r—1 

By Lemma 15.21 and (15.131) , 

I|G,||2 < ||KI|2 + C3V/2“ < C4ivi 


By (|5.3I) . Il^nlb < ( 752 ^“. Thus, HT^Ib < 2‘^'^CqN^ . Therefore, by the martingale 
orthogonality property and since N — INi < I, 


(5.14) 


11 ^ 7 11 

= C5Z22“ + (^flj|r,.||i)i 


Ni 

<C5/22“ + ||^T,||2 

r—1 

^ (I /7 . 


The lemma follows by (15.131) and (I5.14L writing as sum of those two 

differences and then applying Lemma 15.31 □ 


Proof of Proposition \5.1l First write 

iN iN iN 

^ E{Z^) = EHY, ^.i-,2“))- 

n—1 n—1 n—1 

_ _, nu(N) A+6 X 

By the same reason as in (j5.13p and since < 2N < 2N ^(x+s) ^ 

iN 

I-^ E{Z^) - ^;(eS(^)eg(*))l < CiiV-™, u = u{N). 

n—1 

By (15.51) . Lemma r5. 21 and the Cauchy-Schwarz inequality, 

- C*,iv(*)e7,^b)ll2 < C22-“^ < C^N-^. 

As in [S], Ar(i)) — iDi j \ < C 4 for some constant which depends on the 

initial parameters and on the expressions (12.81) and (12.91) . Thus, 

^ iN . iN 

(5.15) ||^^Z„-7A,,||2 < ^||^^„-£;(Z „)||2 + C 5 fV^. 

n—1 n—1 


Now we estimate the first term on the right hand side of (15.151) by Lemma 15.41 
applied with iN and the lemma follows. □ 
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5.3. Proof of Theorem I2.5L Let = M^\ n = and Wn = 

Wn^\ n = l,...,£iV be the martingale array and the corresponding martingale 
differences from Section Ol Let cr^ > 0 be the limiting variance. Applying Theo¬ 
rem 2 from [9] with <5 = 1, and e = cr“^> taking into account 
the Markov inequality and that always EZ‘^l^\z\>i] < yields 


(5.16) dK{C{N-^/^Mm). M{0, a^)) = dKiCiN-^/^a-^Mm), M{0, 1)) 

< A(iV-2/3a-4/3yi + N-2/s^-ivj + 


II) 


where A > 0 is an absolute constant and 14 ,w = ^^n- 

Next, by (15.21) . (15.31) and the formulas for Wi^n, 2 '‘, and Wn''^ we obtain 

that lliri^^llb < (72“^^^ for some constant C > 0 independent of N, and so Vli^Ar < 
jy(^424M(Af) pij^aiiy, (15.61) and (15.161) together with Proposition [FH] and Lemma 15751 
yields the first assertion of Theorem 12.51 In order to prove the second assertion 
we take u{N) = [l2S2(^fS|i7711] in place of and repeat the the proof of 

the first assertion, with appropriate modifications, using the fact that with cs = 
c^, n'^{wq^p{n) + I3^{q,n)) < Md" for some 1 > 0 > and Y^^= 2 ^{P{'iw)Y 4 
s y^oo „n _ „s 

^ 2^n=2^ 


rW) 


□ 


6. Special cases, extensions and concluding remarks 

In this section we provide better estimates for the i.i.d. case, extend results to 
more general qj (n) functions and consider also the continuous time case. 

6.1. Independent case. When {X{n)}n>i are i.i.d. random variables we do not 
assume (12741) and (1231) but only that F(A(1),X(2), ...,X(f)) is a nonconstant ran¬ 
dom variable having third moment. The case f = 1 is the ’’conventional” case, so 
we assume that f > 1 and set 

N 

Sn = ^ A(A(n),A(2n),...,A(n£)). 

n—1 

As in Section 2 from [15] Sn can be splitted into sum of independent (blocks) 
random variables as follows. Let > 2 be all primes not exceeding i. Set 

A„ = {1 < a < n : a is relatively prime with 4, h---, Im} 

and 

Bsia) = {b < s : b = for some nonnegative integers di,d 2 ---, dm}- 

For any a € Aj^ put 

SN,a= FiXib),Xi2b),...,X{eb)). 

Then, the distribution of Sn,a depends only on |iljv(a)| where |il| denotes here the 
cardinality of B. Observe that {S'jv are independent random variables and 

that S]\f = "^neAN FN,n- 

6.1. Assumption. Suppose that 

AF(A(1),X(2),...,A(£)) = 0, 0<d^=EF^X{l),X{2),...,X{£)) 
and r3 = A|A3(A(1), A(2),..., A(£))| < oo. 
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6.2. Theorem. Suppose that Assumption 6.1 holds true. 
limAr_>oo Var{SN) exits and satisfies 


1 1 

(6.1) _(i_ ]^(i__))d2 <^2 <^2^2 

fe=i ^ 

and for all N >1, 

.7 (Sn (l + log2iV)3™max(r3,l) 

( 6 . 2 ) - 


Then = 


where C > 0 depends only on i (and this dependence can be recovered explicitly 
from the proof below). 


Proof. We will use the construction and techniques from Section 4 in [15) . Put 
ZN,a = ESI,, Zn = ESI = Ea6A„ ZN,a, 

m 

D{p) = {n= {m,.., Urn) G Z’” : rii > 0, i = 1,.., m and ^ Ui ln(/i) < p}. 

i=l 

Similarly to Section 4 of [TS] we conclude that is determined only by |i? 7 v(a)| 
(where |r| for a finite set P denotes its cardinality), and so we can set Ri = Z^^, if 
I = |iliv(a)|- Observe that Ri = EF'^{X{1), ...,X{tj) = df > 0 and that 

(6.3) Ri < fEF‘^{X{l),..., X{(.)) = I'^d? 

in view of the inequality ^ Section 4 of [15] it was 

shown that the numbers 


Pmax(0 = sup{p > 0 : \D{p)\ = 1} and Pmin{l) = inf{p > 0 : \D{p)\ = 1} 
are well defined and satisfy 

(6.4) (1- - 1) ln2 < pmin(0 < Pmax(0- 
Next, set 

41^^ = {a G An : \B]\[{a)\ = 1} 

and 

A^^ = {a G An : < a < 

In (4.6) and (4.7) from [15] it was shown that 

(6.5) |4)| < and - |i«|| < 1. 

As in (4.10) from [T5] with |G^^(n)| = [A(e“Pn'in(0 _ g-pmax(O)]^ 


and hence 


k—l s—1 


|l|d(0 
'n' 




N 


ce 


= i-n<i-7:) = E(-i) 




E n 


where 
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Therefore in view of (j6.5p . 

(6.6) I —< —— 
By (4.3) in [H], 

(6.7) |S^(a)| < (1 + In -)™ = (1 + log^ -) 

inz a a 

It follows that 


( 6 . 8 ) 


— 7 

N^n 




aG .A jv 
oo 




N,i 


= ^E 


N Z^l<l<{l+log2 N)’ 


1^: 


^n^\Ri 


N—¥oo 


CiEZiie 


Pmin (0 _ g Pma 


-R^Ri = 


where the last series converges absolutely in view of ()6.3I) and (16.41) . 
Next, we will need two following inequalities 

(6.9) I^Var(5^) - < ^(1 + log^ 

where C > 0 depends only on £, and 

(6.10) c(fN < Var(S'Ar) < i'^cfN 


where d is from Assumption 16.11 c > 0 depends only on i and we claim the left 
hand side of (16.101) only for N > ^ k. Indeed, by (16.31) - (16.61) and by the last 

equality in (I6.8L 

(6.11) 1;^ Ei<i<(i+iog2 Af)”* l^y \Ri ~ ^^1 

N El<i<(l+log2 Af)™ ^ ) 

< d‘^r( V ;2r,-d/™' I (l-Hog2 Nf"' \ 

where C > 0 depends only on i. Next, 

E / 2 o —— 
i>(l + log 2 AT)™ ‘ ^ - Z^j = l Z^(i-Hl)™(H-log 2 Ar)™>J>i"*(l-elog 2 AT)™ ‘ ^ 

< ^(l + log2iV)3-X:“l(j + l)''"2-^' 

which together with (16. lip yields (j6.9l) . In order to obtain (I6.10p . observe that 
|i?Ar(a)| = 1 for any a £ An with a > ^, and so then Var(S'iv,a) = Thus, 

Var(5^) > \ANn{^,N]\d\ 

From the definition of Pmax and pmin it follows that Pmax(0 = Pmin(^ + 1) which 
together with (j6.6p yields 

(6.12) limAT^oo ;^|^Af| = limjv^oo Eti 

= C£ _ g-Pmax(O) = g^g-Pmin(l) _ g^^ 

Hence, limAr_>.oo ;^I^Afn(Y) 1^]| = implying the left hand side of (I6.1F Observe, 
in addition, that lA^v O (^, iV]| > 0 whenever N > 2 Y\aLi since then there exists 
n > N/2, n < N which is divisible by WZLi and soa = n-|-l<7Vis relatively 
prime with /i, These yield the left hand side of (16.101) . Now, notice that for 

a given n G N there are at most m’s such that 


E{F{X{n ),..., X{en))F{X{m ),..., X(£to)) ^ 0 
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while for any n, m G N the Cauchy- Schwarz inequality implies that 
\E{F{X{n),...,X{£n))F{X{m),...,X{em))\ < (f 

and the right hand sides of ()6.10|1 and of ()6.1|1 follow. 

Next, since \x~^ —y~^\ = {xy)~^{x^ +y^)~^\x — y\, (16.91) and (16.101) imply that 
for N > 2 0^1 h, 

1 1,1 


< 


-N 2(7(1 -(- iog2 iV) 


3m 


Y^Var(S'jv) VXa'^ ccPcr 

By the left hand side of (16.101) . > ccP which together with the right hand side 

of (16.101) yields from here that 

(6.13) ||^_^^||,< 1 


3m 


,_. ,_,_- .f.^.N-^C£il + log2N) . 

v'Var(5'Ar) 

Next, using (16.71) and the inequality (Yti ^ obtain 


< (1 + log 2 N f^F\F'-^{Xil ),..., xm = (1 + log 2 Nf^r^ 


Now, in order to prove the last assertion of Theorem 16.21 we apply the assertion 
4.1.b from Chapter 4 of [I] which yields together with lower bound from (j6.10l) that 
for some absolute constant C > 0 and all N > 2n™ i h, 

(6.14) 

Sn ^ NN-S ,.S ^ ^ s(l + log2^)^™ 


d;f(-=^4=,Ar(0,l)) < C(Var(5^))-i V < Cr^ 

\/Var(5jv) 


ciNhd^ 


where (7 > 0 depends only on £. Now, (I6.2I) follows from (I6.13I) . (I6.14I) . Lemma 3.3 
applied with a = 1 and the fact that 

dK{-^,M{0, a^)) = 1 )). 

Observe that though we claim (16.141) only for iV > 2 Hi^i f^e estimate (16.21) holds 
true for all > 1 with some constant C depending only on £ since by Jensen’s 
inequality > d?^ and so max(r^, 1) > cimin(l,(i^) which enables us to choose C 
so that (ESI) is satisfied also for 1 < TV < 2 


6.2. Nonlinear functions qj. Here we discuss the case k < £, where recall, 
qj{n) = jn ior j = and qj{n + 1) — qj{n) and qjisn) — qj-i{n) tend to 

oo as n —>■ oo whenever £ > j > k and £ > 0. First, observe that we can ex¬ 
clude the case when F(xi,xe) = G(xi, ...,Xk) for some Borel function G and 
= y X ■■■ X y almost all (xi,..., x^) since then we arrive at the setup of Theorem 
12.51 The above equality means that F does not depend essentially on the variables 
Xfc+i, ...,Xi and this is equivalent to the condition that 

(6.15) Fi = 0 yd — almost surely (a.s.) for d\\ i = k + \, ...,£. 

By Proposition 4.5 in m. for any i > k, 

Di i J" F) (xi,..., Xi'^dyL (xi,..., Xj) , 

and so if the above case is excluded then Di^i > 0 for at least one i > k. This 
together with Theorem 12.21 yields that then > 0 whence this question is settled 
here and it remains to deal only with Berry-Esseen type estimates. 
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6.3. Theorem. Let k < i. Suppose that Assumption \2.1\ is satisfied with some 
a, A > 1 and 6 > 4 and that there exists 1 > 7 > 0 such that gi([n'>']) > qi-i{n) and 
qfin + 1) — qfin) > for any k < i < £ and n £ N. Assume that \6.15\) does not 
hold true. Then for any N G N, 


min(a,A) —1 


where 0 ( 7 , a, A) = min(^(l — 7),-^ 

were introduced in Theorem \ 2. ‘A Dq q = cto = E 


7 min(Q:,A) 
2+7 min(Q:,A) 




A 

4(A+4) 

mm{i,j)D^j, 


); ^i,j ? 1 — LJ — 


R = 


1 + 


( max D- /) ( max 

ie{0,fe+l,...7}:Di,i>0 ’ k<j<£ :Djj>0 


ma.x{DjJ 


4 



and C > 0 depends only on the initial parameters and the expressions 


As in Theorem 12.51 the main step in the proof of Theorem 16.31 is the construc¬ 
tion of martingale approximations and their estimates. Still, unlike in the case 
k = £ we cannot provide here approximations of the whole process \/n£^n{^) by a 
single martingale. Thus, we will use separately the martingale approximation for 
Ci, 11 ( 1)5 > 1 constructed in Section[S]and the martingale approximations 

of each n> 1, i = k + ...,£ relying on Lemma 16.51 below. 

For any i = k + 1, ...,£ and fixed u,N £ N, we construct the martingales 
= En=i lh,gi(n), 2 “ with respect to the filtration {J'_oo, 9 i(n)-i- 2 “}n>i 5 where 
similarly to Section [Sj 


R 


i.Qi (i;) ,u 


'^[h,gi(s),2'‘|■^-oo,Q'i(lI)-|-2'‘] and 

s>u+l 








Let u(N) = Using techniques similar to Section [5] we obtain that for 

any N > L and i > k, 


< 


(6-16) 

C{^+ Er=2^(-) r)f)< +N-^) 


where Ci > 0 depends only on the initial parameters and the expressions (j2.8p -- 

(12:^ . 

Next, observe that the proof of Lemma 1^71 also works for our setup and so. 


[NT 

(6.17) ||^U^.,.(„)||2<CiV^ 

n—1 

where C > 0 depends only on the initial parameters and the expressions 
Hence, applying LemmaEJlwe can replace Y.n=i ^^,qi{n) by Yln=[N-'] Ui,gi(n)with an 
error estimated by (16.1711 . Thus, for i > k and hxed N we consider the martingales 
(lUi.Af) (with respect to the filtration {.77oo,gi(n-i-[JV^])-i-2“(") }n>i)) where = 

for N - [iVT-] > r > 0 , (M,,^), = M,,n-[nt for 
r > N — [TV'*']. As in the proof of Theorem 12.51 quadratic variation estimates are 
crucial. Combining methods of Proposition 4.5 from m and Lemmas 15.31 and 15.41 
above we obtain the following result. 
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6.4. Lemma. Suppose that Assumption 2.1 holds true with a,A > 1 and that there 
exists 7 satisfying conditions of Theorem \6.A Let k -\-1 < i < ^ and iV, u G N such 


that 2“ < TV 8 . Set Zn = Z, 


(i,u) 


= W^ . 


0 . 2 “ 


Then 


N 

^ V - A ,.||2 < + 2 - 


'N ^ 

n—1 


+ 2^^N- 


where r(a, A, 7 ) = iinin(l — 7 , ^ ^ depends only on 

the initial parameters and on \2.A) - T2.9\) . Furthermore, let 1 < i < j < k and set 
Zn — ■ Then 


'N 


iN 

^ ^ Zn 

n—1 


< C{N- 


(min(a, A) — 1) 


+ 2 


+2^“iV-3). 


The use of approximations by several martingales as explained above works in 
the proof of Theorem l6.3l in view of the following result which is the main additional 
argument needed in comparison to the proof of Theorem l2.5l Let 5 i(n) < ... < gi{n) 
be positive and strictly increasing functions taking integer values. Set 

Kn = max (min{l < m < N : gj{m) > gj-i{N)}). 


6.5. Lemma. Let the Fn,m be 0 , nested family of a—algebras (see Section Let 
N gN and suppose that i = 1, is a martingale differences sequence with 

respect to the filtration {iF_ao,gi{n+Ki N)}n>i where Ki jg = 0 and if 

i > 1. Let he the corresponding martingales. Suppose that max{||W,l‘ '^lU ■ n < 
N,i tS 1} ^ ( 712 “ for some positive constant Ci independent of N and u > 0 such 
that 2“ < for some 0 < C < 7 - Let di,...,di > 0 and assume that 

max{||M ^^||2 : i = l,...,l} < C 2 

and that max{A 2 ,s : s = 1,..., /} < C 3 N~^ for some 0 < 9 < 1, where 



n—1 


and ( 72,(73 > 0 are positive constants independent of N. Let rji, i = l,...,l be 
independent and centered normal random variables having variances df. Then 


dK{^ V^) < C{1 + mi„(5e.26(l-2C)-8e) 


2=1 


2 

where C > 0 is an absolute constant, B = B{l,Ci,C 2 ,C^) = liB.ax.{C^ ,1(1 + 
C 2 ), D max((7f ,Cl)), D = max{i7s : 1 < s < 1} and Dg = ina.x{ds ,ds ^). 


Proof. First, observe that if Z\,Z 2 and .^ 3,^4 are pairs of independent random 
variables then 


(6.18) dxiZi + Z 2 , Z 3 + Z 4 ) < d_R-(Zi, Z 3 ) + dK(Z 2 , Z 4 ). 

By taking the product measure we can always assume that {Wn \ n > 1} and 
{ 7 i}i=i 8 '!'® defined on the same probability space and are independent from each 
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other. For any s = 1 ,I set 


= and 6is) = dKiY^^\^V^)■ 

The main step of the proof is showing that for any 2 < s < I and U^L gN 

(6.19)5(s) < C((l + (ELi dl)-hiSis - 1) + Dsii^UL)i + {£^^UL)i) 

+ iC3N-'^UL)i + 1(1 + C2)i^ + i)i) 

where C > 0 is an absolute constant. 

Indeed, for any random variable Z and U,L € N set 

k 

E Tf\^< 


k=-LU 


U and \z\<l}- 


Observe that by the Holder inequality, for any q > 1, 

(6.20) ||Z - Zl.uWi <^ + ||i?[|^|II{|z|>L}||i < ^ + 

In order to proceed we need some relations between probability metrics which 
can be found in [7]. Denote by dp the Prokhorov metric on K and by dp the Levi 
metric on K (see [7]). Then for any distribution functions F and G, 

(6.21) dp(F,G) < dif(F,G) < (l+sup|G'(x)|)dp(F,G) and dp(F,G) < dp{F,G) 

x£M. 


where the right hand side of the first inequality holds true if G is differentiable. 
Moreover, by the the Markov inequality and some standard estimates, one can show 
that for any random variables X and Y which are defined on the same probability 
space with distribution functions F and G, 

(6.22) dpiF,G) =dp{X,Y) < 2\\X-Y\\f. 

Proceeding with the proof of (|6.19p we observe that by ()6.2I|) . 

d(s) = dK(r(^-i) + < 

(1 + (ELi df)-^)dp(y(-i) + e:=i m)- 

By triangle inequality and then by (16.211) and (I6.22L 


dUY^^-^^ + + dp ( Fy -^) + + r ;,) 

+dp(yy-') + 77 «, + Vs) + dp(F(*-i) + Vs, EUl m) < 




Vs 


^ L,U Ml Yn N ^-^L,u 

d^(y(-i) + J 2 Ui v^) =Ii+l 2 + h- 

By (16.1811 . since and Vi,i = are independent random variables, /a < 

<5(s — 1). By (16.2011 applied with q = 2, 


i<f<Jl^^^ll2)(^ + ^)i < 4Z(I + G2)(^ + i)i 
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Next, for any measurable set A satisfying P(A) > 0 let Pa = ^’(•|^) be the cor¬ 
responding conditional probability. For any probability measure /i we denote the 
expectation with respect to it by £1^. For any y G R set Ay = = y} and 

F = {y : P{Ay) > 0}. Then, for any a S R taking into account that F is a finite 
set, 

(6.23) < a) = E nAy)PA,{^M^^'^ <a-y). 

It A G G then Epj^[Z\G] = 1aEp[Z\G] and hence {Mr*^}r>i is also a martingale 
with respect to the measure Pa^- Next, we apply (15.161) with S = l,p = 2 and use 
tha.t Ep^[\Z\] =-pf^Ep[\Z\lA] < ■p^Ep[\Z\] which yields 

(6.24) \PA^i-^M^^^ < a-y)-P{r]s <a-y)\< ADs{c^ + + P~HAy)Al^), 

where c = P~^{Ay)Cf2‘^'^N~'^ and A > 0 is an absolute constant. Observe that 
cardinality(r) < 3LU. This together with (16.231) and (I6.24L the upper bounds 
for ^ 2,8 and 2“ and the inequality d — any Ci > 0 and 

0 < t < 1 yields 


h<A'D,{{ 




UL) ^ -l- ( 


CfN^C 

iV2 


UL)i + {C3ULN-^)i) 


where A' is an absolute constant and (16.191) follows. Finally, applying (15.161) with 
the martingale taking into consideration that 2“ < N‘’ < y/N and ^ 2,1 < 

C 3 N~^ we obtain 




<5(1) < Amax(Cf )14i(( —)5 + (C'siV-^)^). 

Making a repetitive use of (16.191) for s = 2, 3,..., Z yields 

{{^UL)-. + {^UL)i) + iC3ULN-^)i + l{l + C2)(i + 


The lemma follows by taking U = L = [N^^] (the power y| is obtained by consid¬ 
ering L = U = and then comparing the obtained order of N in the last two 
above summands). □ 


In order to prove Theorem 16.31 first apply Lemma 13.31 taking into consideration 
(I6.16p - (|6.17p . Then apply Lemmas 16.51 and 16.41 with the martingales Mi,jv for i’s 
such that Di^i > 0 (where I?o,o = cto) with <C = 2 {x+ 4 :) ^ “ min(T(Q!, A, 7 ), |) < 

2 ( 1 - 20 - 

6.3. Continuous time results. Here we explain how to obtain convergence rates 
in the Levy-Prokhorov metric m Ch. 1, Sec. 6 ) in the case A: = £ for the continuous 
time processes (t) defined in Section [2] Such results when k < £ will not be 
dealt with here since it is not clear how to adapt Lemma 16.51 for continuous time 
martingales, and so a different approach should be employed. It also possible to 
obtain such rates for the one dimensional processes for i = fed- 1, ...,£. First, 

relying on the Holder inequality for any random variables {Xi}i<cm 

max {|A:,|}] < ni max {HATiHJ 

l< 2 <n l<i<n 
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we obtain by (15.6p that for any 1 < i < £ the martingale approximation estimates 
is in the form 

^ (/3(g,n))h 

where ||/||t.oo = sup{|/(t)| : t e [ 0 ,T]} and ^ ELU 

with Ri(n) = " for i < k and Ri{n) = n for i > k. Concerning quadratic variation 

estimates we obtain the following result. 


6 . 6 . Lemma. Suppose that Assumvtion \2.1\ is satisfied with some a > 1,A > 2 
and b > 4 and that there exists 7 as in Theorem \ 6.tA Let 4 < i, j < ^ such that 
4<i<j<k or i=j>k and u,N £ N such that 2“ < . Let T > 0 and 

AT = \/T(r+L). Then 


EL=‘1 - ^Aj||t,oo < ca1t(2-“(^-i) + 2“iV- 


/ min(Q, X) — 1 \ 




_/ 7 min(Q:,X) 

2 + -y min(Q,X) ’ 5 £ 


)) 


where Di,j were introduced in Theorem \2.‘A C depends only on the initial parameters 
and the expressions il^.igD - dX^) and for i,j < k, Zn = while for 

l = j>k, = W, 2 ^ 7 „), 2 - 


In order to prove Lemma 16.61 we have to improve somewhat Lemmas 15.31 and 
15.41 obtaining similar results for expressions of the form ~ L^^n )||2 

with z < N using the same technique and then applying Proposition 3 from m- 
Finally, we can apply some Berry-Esseen type estimates (for instance, from [ 6 ]) for 
continuous time martingales which will yield corresponding estimates in our setup. 


6.4. Integral type expressions. Next, we discuss how to obtain similar results 
for expressions of the form 

1 

where again qi{n) = in for all i. We introduce a reduction to the discrete time 
case where we can apply the technique used above for expressions (O. First, we 
represent again the function F in the form (12.111) and write 

I j-Nt/i 

6 .Af(£) = -^ J Fi{X{qi{t)),...,X{qfit)))dt. 

We will use below the same notations as in (j3.3l) with n replaced by t (see Section 
6 in |14jb In order to apply our discrete time technique set 
where Ji(n) = fg Vi(qi(n + s))ds. As in (6.2) from [14] applied with S = b — 2, 

P{ sup |^i,Ar(t) - i^,N{t)\ >e)< ^ 

o<t<T [e\/N)°~‘^ 

_(1 b -2 N 

which by taking e = en = N bounds the Levi-Prokhorov and the Kol¬ 

mogorov (uniform) distance between and by Cen < CN~3. We can 
approximate f,i,N(t) by 

[Nt/i] 

n—1 
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where Ji^r{n) = fg Yi^r((li(n+s))ds using an appropriate version of (15.61) (see Section 
6 in |14j ). As mentioned in |14) we will have an appropriate continuous time version 
of (15.51) with the expressions 

OO 

^ ^ _oo,m+r) 

/—m+1 

and the martingale differences Zi^rijn) = Ji,r{m) + Ri,r(jn) — Ri^rijn — 1). In order 
to extend the results of Section 5 to the present case we should have a continuous 
time version of Lemma 13.41 Such a version (adapted to our specific setup) follows 
directly from the observation that the bound from Lemma 13.41 depends only on the 
gaps between the sets Mi there and the initial parameters together with the facts 
that for Tj(sj) = {X{qi {rij + Sj)),X{qij{nj + Sj))) and integrable functions G 
and Gi, i = 1,..., m, 

E /[o,i]m G'(Ti(si), ...,Tk{sk))dsi...ds,n 

= /[o.i]™ i'Riisi), ...,Tfc(sfc)) dsi-.-dsm^ 

EYYJLi fo dsj = n^i G* {Tj{sj)) dsi...dsm and 

UZi^ilo Ms)ds] = An™i/o^ X,(s)ds = E X,{s^)dsi...ds^ 

where Xi{-),...,Xk{-) are independent random functions. 

Using the technique from Section [S] with appropriate modifications we can prove 
a corresponding version of Proposition [FH] which will yield some Berry-Esseen type 
convergence rates as above. □ 
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